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?H ' Abstract 

The main theorem of this paper estabhshes conditions under which 
the "chaos game" algorithm almost surely yields the attractor of an 
iterated function system. The theorem holds in a very general setting, 
even for non contractive iterated function systems, and under weaker 
conditions on the random orbit of the chaos game than obtained pre- 
viously. 



1 Introduction 

There are two methods for computing pictures of fractals that are attractors 
of iterated functions systems, the deterministic algorithm and the more effi- 
cient "chaos game" algorithm [2]. This paper concerns the chaos game on a 
general iterated function system (IFS) T defined on a complete metric space 
(X, d). The iterated function system is "general" in the following sense. The 
only restriction placed on X is that it is proper, i.e., closed balls are compact. 
The only restriction on the functions in F is that they be continuous. In par- 
ticular, they need not be contractions on X. In fact, none of the functions 
needs to be a contraction on X with respect to any metric giving the same 
topology as the original metric d. This paper provides a natural definition 
of an attractor of such a general IFS. A general IFS may possess more than 
one attractor, one attractor, or no attractor. Examples of iterated function 
systems that are non contractive yet possess attractors are given in Section HJ 
The main result. Theorem |3l is new in that it shows that the chaos game 
algorithm can be applied to such a general IFS - in particular to situations 
where there is no metric, even in a neighborhood of the attractor, with respect 
to which the IFS is contractive. We show that the chaos game algorithm 
almost always yields the attractor. More precisely, if the IFS has an attractor 
y4, then a random orbit, starting with a point in the basin of attraction of A, 
converges with probability one to the attractor. We show this under weaker 
conditions than have heretofore been described. In all other papers on this 
topic, of which we are aware, for example [3], |1], [8], [11], [13], [15], [19], 
[21] . [22], it is required that the IFS be either contractive, or contractive on 
the average. It is also required that the process by which the functions are 
selected to generate the orbit is stationary and that the selection process 
depends Holder continuously on the initial point; see for example [20]. For 



our result, none of these conditions are required. The only constraint on how 
the functions are randomly selected, one after another, is that, at each step, 
there is the possibility of choosing each and any of the functions, and that 
the probability of so doing is bounded below away from zero. 

We do not ask, as is customary in descriptions of the chaos game algo- 
rithm, that the process be i.i.d. or that it be conditioned on the "past" in 
some restricted way. This is because we are not concerned with the existence 
of an invariant measure associated with a chaos game on an IFS. For such 
an invariant measure to exist it is typically required that an associated tran- 
sition probability operator is suitably well-behaved, see [IT] and references 
therein. Since we are only concerned with the relationship between random 
orbits and attractors of an IFS, we are able to obtain almost sure convergence 
of random orbits to attractors in very general situations. 

Section 2 of this paper contains basic definitions, in particular the defini- 
tion of an attractor of an IFS. Theorem [2] in Section 2 provides an expression 
for an attractor, of some independent interest, that will be used to prove the 
main result. The main result on the chaos game is Theorem [3] in Section 3. 
Section 4 contains examples that illustrate the practical value of Theorem [31 

2 General iterated function systems 

Throughout this paper (X, dx) is a complete metric space. 

Definition 1 // /„ : X — )■ X, m = 1,2, ...,M, are continuous mappings, 
then T = (X; /i, /2, ..., Jm) is called an iterated function system (IFS). 

By slight abuse of terminology we use the same symbol J-" for the IFS, 
the set of functions in the IFS, and for the following mapping. Letting 2^ 



denote the collection of subsets of X, define T : 2^—7-2^ by 

nB) = u f{B) 

for all E G 2^. 

Let EI = ]HI(X) be the set of nonempty compact subsets of X. Since 
J-" (H) C EI we can also treat J-" as a mapping J-" : EI — t- EI. Let d^ de- 
note the Hausdorff metric on EI, defined in terms of ci := d^- Using the 
notation 

S + r = {y eH : d{x, y) <r for somea; G 5*} 

with 5 C X and r > 0, a convenient definition of the Hausdorff metric (see 
for example [121 P-66]) is 

c/jj(5, C) = inf {r > : B C C + r and C C B + r} 

for all B,C em. 

A metric space X is locally compact if every point has a compact neigh- 
borhood and is proper if every closed ball {y : d{x,y) < r} is compact. 
Proper spaces are locally compact, but the converse is not true in general. 

Lemma 1 1. A metric space is proper if and only if C + r is compact 

whenever C C X zs compact and r is a positive real number. 

2. //X is proper, then T : EI(X) — )■ EI(X) is continuous. 

Proof: Concerning statement (1), clearly the condition on C + r in the state- 
ment of the lemma implies that the metric space is proper. Just take the set 
C to be a single point. 

Conversely assume that the metric space X is proper. Because C is com- 
pact, C is totally bounded. This implies that C is bounded, and hence C + r 



is bounded. Therefore there is a closed ball B such that C + r d B. But B is 
compact because X is proper. Therefore B is totally bounded. This implies 
that, for any e > 0, there is a finite set {Bi := B{xi,e) : i = 1,2, . . . ,q} 
of closed balls of radius e centered at the points Xj such that C + r G B G 
Ul^^Bi. Therefore C + r is totally bounded. Since C + r is also closed, it is 
compact. 

Concerning statement (2), for any i? G H, we will show that J-" : EI —t- EI is 
continuous at B. Since X is proper and B is compact, statement (1) implies 
that B+1 is compact. Therefore each / G J-" is uniformly continuous on B+1. 
It follows that, for any e > 0, there is a 5 > such that dx{f{x), f{y)) < e 
whenever dx{x,y) < 6, for all x,y G B + 1 and for all j G T . Without loss 
of generality, take b <1. 

Let C G EI with d^{B,C) < 6 and let / G J". We will show that 
dm{f{B),f{C)) < e. Let b' G i\B) and b G B such that f{b) = b' . Since 
d]ii{B, C) < 6 there is c G C such that d{b, c) < 6. Since (5e < 1 we have c G 
B + 1. It follows that d{f{b), /(c)) < e and therefore that f{B) C /(C) + e. 
By a similar argument /(C) C f{B) + e. Hence du{f {B) , f {C)) < e for all 
/ G ^. Finally d^{F {B) , F {C)) < max;e^rfH(/(fi), /(C)). D 

Statement (i) of the following foundational results is well-known. A short 
proof can be found in [12, p. 67, Theorem 2.4.4]. Statement (ii), also well 
known, can be found, for example, in [H]. Statement (iii) is a classical result 
of Hutchinson [161 . 



Theorem 1 (i) The metric space (EI, dm) is complete. 

(ii) If (X, dx) is com,pact then (EI, dm) is com,pact. 

(iii) If f : X — T-X is a contraction mapping for each f G T , then T : 
EI — )■ EI zs a contraction mapping. 



For 5 C X, let J^^{B) denote the k-io\d composition of J-", the union 
of /jj o /j2 o ■ ■ ■ o fi^,{B) over all finite words iii2 ■ ■ -ik of length k. Define 
J^\B) = B. 

Definition 2 A nonempty compact set A C X zs said to he an attractor of 

the IFS 7 if 

(i) J^{A) = A and 

(a) there is an open set t/ C X such that A G U and linifc_j.oo-^^(-B) = A, 
for all B G M.{U), where the limit is with respect to the Hausdorff metric. 

The largest open set U such that (ii) is true is called the basin of at- 
traction for the attractor A of the IFS T . 

The following observation [TSl Proposition 3 (vii)], [121 p. 68, Proposition 
2.4.7] will be used in proving Theorem |2J 

Lemma 2 Let {-Bfc}^;^ he a sequence of nonempty compact sets such that 
-Bfc+i C Bk for all k. Then r\k>iBk = hnifc^oo -Bfc where convergence is with 
respect to the HaudorfJ metric. 

The notation S is used to denote the closure of a set S, and, when f/ C X 
is nonempty, M.{U) = EI(X)n2^. The quantity on the right-hand side of the 
equation below is sometimes called the topological upper limit of the sequence 
1^*^(5)} and is related to other definitions of attractors of generalizations 
of the notion of an IFS; see for example McGehee |9j and Lesniak [TS], and 
references in both of these. We will use Theorem [2] in the proof of Theorem 
El our main result. 

Theorem 2 Let T he an IFS with attractor A, with hasin of attraction U. 
If J^ : EI(f/)— 7- EI(f/) is continuous then 



^ = n u '^'(^) 



K>lk>K 



for all B CU such that B G W{U). 

Proof: We carry out the proof under the assumption that B G EI(f/). It then 
follows from [18, Proposition 3 (i)] that Theorem |2]is true for all -B C f/ such 
that S eH(C/). 



Clearly |J^>^ J-''^(i?) is nonempty because B is nonempty. We next 
show that \J^^j^F^{B) is compact. Let {Oi : i G X} be an open cover of 
\Jk>K^KB). Since Ufc>x^'(^) C LW^^bJ and A = \imk^^ J'^B), 
also {Oi : z G X} is an open cover of A. Because A is compact, {Oi : i G X} 
contains a finite subcoUection, say {Om '■ fn = 1;2,..,M}, such that A C 
O := U^^iOm- Because a metric space is normal, there is an open set 
O' containing A such that O' C O. Again using that fact that J^'^(B) 
converges in the Hausdorff metric to A, there is an integer K' such that 
J^''(B) C O' for all k > K' . It follows that Ufc>i^' J^'"(B) C C and therefore 



Ufc>^^'=(fi) C O = U*^=iO^ for all K > K' . Therefore \J^^j,F>'{B) i 
compact iiK>K'. \i K < K\ then 



U ^'^(i?) = U F\B) U U ^^=(5). (2.1) 



k>K K'>k>K k>K' 



Since each function / G -F is continuous and i? is compact, F^{B) = J^'^^B) 



is compact. Hence IJA:>ii' ■^''(B), the finite union of compact sets on the right 
hand side of equation 12. 11 is also compact. Since |J^>^ J^*^(_B) is a nonempty 
compact set, the nested intersection 



^ ^= n u •^'(^) 

is a nonempty compact set. 



K>lk>K 



Now observe that 



J^fA]=J^i lim y T''{B) j (by Lemma [2]) 

\ °° k>K J 

\fc>X / 

lim U .^ ( U •^*'^^) I ^^y *^^ definition of J^) 



since J-" : EI — )■ EI is continuous) 



lim M / M J^'^iB) j (since / : X — t- X is continuous and 
^°° fer \k>K J 



^k>K^^{B) is compact) 



lim M / M J^^{B) j (since M is a finite union) 



f&F \k>K / feT 



lim U U /(J-^(5)) 

k>K f&T 



= lim 1 I F^iB) = A. 

k>K 

By an argument essentially the same as used above to show that 



^k>K-^'^i^) ^ ^1 i^ "^^^ ^^ shown that Ufc>/<J-''^(i?) for K sufficiently large, 
and hence A, lies in U. 

Since A is nonempty, compact and lies in f/, the basin of attraction of A, 
we must have 



A = lim T''{A) = A. 

k—^oo 



3 The chaos game algorithm 

The following lemma will be used in the proof of Theorem EJ 
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Lemma 3 Let X be proper, and let T = (K; fi, f2, ■■■, Jn) be an IFS with 
attractor A. For any e > there is an integer M = M{e) such that for each 
X & A + e there is an integer m = m{x,e) < M such that 

dM{A,T'^{{x})<6/2. 

Proof: Because X is proper and A is compact, A + e is also compact by 
statement (1) of Lemma [H There is no loss of generality in assuming that e 
is sufficiently small that A + e G U, where U is the basin of attraction of A. 
lixGA + ecU, then there is an integer m{x, e) > such that 

dM{A,J^"'^-^'\{x})<e/4. (3.1) 

This is because limk^oo J^'' {{x}) = A. 

Since X is proper, it follows from statement (2) of Lemma [1] that J-" : 
EI — 7- EI is continuous, whence J^™(^''^) : EI —t- EI is continuous. Since J^''"(^'=) : 
EI — )■ EI is continuous, there is an open ball i?({x},r^) (in EI) of radius 
r^. > centered at {x} such that dM{J^"'^'''''^{x},T'^^'-' '''>{¥)) < e/A for all 
Y G B{{x} , r^). It follows, in particular, that there a ball B{x, r^,) (in X) cen- 
tered at X such that dM{J^'^^''''Kx},r"'^'''^\{y})) < e/A for all y e B{x,r^). 
Combining this with equation 13.11 above gives d^iA, J"^^^''^\{y})) < e/2 for 
all y e B{x,r^). 

The set of balls {-B(x, r^), x G A + e} is an open covering of A^. Since 
A + e is compact, there is a finite subcovering {-B(aj, r^J : i = 1,2, ... ,q} 
such that A+e C U^=i-B(ai,''"aJ- If M = maxj?7i(aj,e), then for any x G A+e 
there is a i such that that x G B{ai, r^J, in which case d^^A, J^"^({x})) < e/2 
for m = m{x, e) := m{ai,e) < M. D 

Definition 3 Let T = (X; /i, /2, ..., /a?) be an IFS and p G (0, 1/A^] fixed. 
A sequence {xk}'^^^ of points in X is called a random orbit of Xq E H if 



^k = fcTki^k-i), k >1 where a^ is selected randomly from {1, 2, ..., A^}, for 
k = 1,2, ..., where the probability that a^ = n is greater than or equal to p, 
regardless of the preceeding outcomes, for alln G {1,2,..., A^} and all k. More 
formally, in terms of conditional probability, 

P{(Tk = n I xo, ai, 0-2, ..., (Tk-i) > p. 

Theorem 3 Let H be a proper complete metric space and 
T = (X; /i, /2, ..., /at) an IFS with attractor A and basin of attraction U. 
If {^k}'kLo ^'5 ^ random orbit of XqEU under J^ , then with probability one, 

A = lim {xfc}^^^ , 

A— i-oo 

where the limit is with respect to the Hausforff metric. 

Proof: We first claim that, given any e > 0, there is an integer K > such 
that 

XkeA + e (3.2) 

for aU k > K. Since X is proper, J-" is continuous by Theorem [H By Theorem 
[2] and Lemma [2], 

A= \im U^^({xo}). 

It follows that, for any £ > 0, we can choose K so that 



XfcG U J^^{{xo}) cA + e 

j>K 

for all k > K, as claimed. 

We next show that, for any e > 0, there is an integer K > such that 

dm{A, {xfc}~ ^) < e 
10 



with probability one, for all L > K. This is equivalent to the statement of 
the theorem. To prove this, let £ > 0. If fC is as specified in the paragraph 
above, then by (13.21) we have xl & A + e for L > K. The attractor A, being 
compact, is totally bounded. Let {a^ : i = 1, 2, ..., Q} be a set of points such 
that A C UrL]^-B(aj, e/2), where B(ag, e/2) is the ball of radius e/2 centered at 
ttq. Note that each a^ and Q depend on e. By LemmaOthere is an integer M 
such that, for each x G A+e, there is m < M such that d]j^{A, J-'™({x}) < e/2. 
Hence 

dM{A,J^{{xL}))<e/2 

for some integer m < M. Therefore there is a sequence of symbols 

(^L+i(^L+2--(^L+m such that /^^^^ o f^^^^_^ o ... o /^^^.(a;^) G B{ai,e/2). (We 
adopt the convention that the composition on the left equals x^, if m = 0.) 
It follows that 

5(ai,e/2)f|K}^l^^-V0, 
or 

B{aue/2)c{x,}tll'-'+e. 

The probability that this event occurs, i.e., that the particular sequence 
CL+iO'L+2---0'L+m is choscu, is greater than p'^^ . By repeating this argument, 
we deduce that the probability that 

B{ag,e/2) C {xk}ttl+[g-i)M + ^ 

is greater than p^^ > 0, for each q G {1,2, ...,Q}, regardless of whether 

or not the preceding events occur. (That is not to say that the events are 

independent.) It follows that the probability that all of these events occur is 

greater than p'3*^. Consider the event Ei defined by 

Q 
[JB{a„e/2)^{x,}t^^''~' + e 

q=l 

11 



The probability of Ei is less than (1 — p'^^^). By a similar argument the 
probability of the event E^., r > 1, defined by 

U B{a„ e/2) ^ {x,}tZ'l'!t:l)QM (^J + ^ 

9=1 

is less than (1 — p'^^^), regardless of whether or not the previous events 
El, E2, ..., Er-i occurred, for r = 2, 3, . . . . It follows that the probability of 
the event Ei fl E2 n ■ ■ ■ n E^ is less than (1 -p^'^'Y, for all r = 1, 2, . . . . This 
inequality holds regardless of the fact that the Er are not independent. To 
simplify notation, let s = (1 — p'^^^) < 1 so that 

pr{Ei n ^2 n ■ • • ) < priEi n E2 n ■ ■ ■ n E^) = s'' 

for all r. This implies that prln'^^Er) = 0. Hence, with probability one, 
there is an R such that 

Q 

[j B{ag, e/2) C {xk}tt^?{%-l)QM + ^■ 

9=1 

Since A C Ug^iB(aq,e/2) it follows that, with probability one, there is R 
such that 

A r It, \^+RQ^^-^ I r 

Because L is an arbitrary integer greater than or equal to K, 

Ac{xk}T + e. 

for any L > K. But by (13. 2 p we also have 

{a^fcj^iC A + e. 

for any L > K. Hence, with probability one 

c?h(v4, {xfc}^^) < e. 

12 



for any L > K. D 

It follows that 

K>1 K>lk>K 

almost surely, for xq & U and 5 G EI (U), for example, B = {xq}. We draw 
attention to this equality because it seems suprising when J-" contains for 
than one function; the set {x^}^ seems sparse in comparison to |J J^^{B). 

k>K 

4 Examples 

Example 1 The IPS T in this example has a unique attractor, yet each 
j ^ T fails to be a contraction with respect to any metric giving the same 
topology as the original metric. With probability one, the chaos game applied 
to this example "draws a picture" of the attractor of the IFS. 

If X = {{x,y) G M^ : x^ + y^ = 1} and d is the Euclidean metric, then 
(X, d) is a compact metric space. Let J-" = (X; /i, /2) where /i(x, y) = (x, y) 
and f2{x,y) = (xcosa — ysina, xsina + ycosa), where a/n is irrational. 
The map /i is the identity map and /2 is a rotation through angle a anti- 
clockwise about the origin. Since neither /i nor /2 has a unique fixed point, 
it follows that there exists no metric d on X such that (X, d) is complete and 
either /i or /2 is a contraction. On the other hand, J-" has a unique attractor 
A = X. To see this, first note that J-'(X) = X. Also, if (xq, yo) £ X then 



J^''{xo,yo) = {fi{xo,yo)} 



j=o 



for all k. The right hand side is well known to converge in the Hausdorff 
metric, as k tends to infinity, to X. If follows that J-'^{B) converges to X for 
all B G EI(X). By definition [2l the IFS J-" has a unique attractor, namely X. 



13 



By Theorem [31 with probabihty one, the chaos game apphed to this example 
"draws a picture" of the unit circle, the attractor of the IFS. 

Example 2 In the same spirit as Exampl^ this is an IFS on the real pro- 
jective plane that possesses an attractor, but there is no equivalent metric with 
respect to which the maps of the IFS are contractive. Again, with probability 
one, the chaos game "draws a picture" of the attractor of the IFS. 

This example appears in [I]. The metric space is (E.P'^, d), where M.P^ de- 
notes real projective two-dimensional space, and d denotes the round metric; 
see pp. Let J-" = (MP^; /i, /2), where the pair of projective transformations 
/i and /2 are represented (acting on homogeneous coordinates), respectively, 
by the pair of matrices 

/I 

and j 2 cos a —2 sin a 

\0 2 sin a 2 cos a 

and a/n is irrational. In terms of homogeneous coordinates {x,y,z), the 
attractor of J-" is the line x = 0. This can be proved by a similar argument 
to the one in Example [1] 

Such non-contractive IFSs occur often in real projective IFS theory. The- 
orem |3] tells us that the chaos game algorithm can always be applied to 
compute approximate pictures of attractors of real projective IFSs. 

Example 3 This is a superfractal example. 

Let (X, dx) be a compact metric space. Consider the IFS 

F = (EI(X); J-*!, ^-"2) where the mappings J-'i : EI(X) — t- EI(X) are the maps cor- 
responding to the IFSs J-'i = (X; /n, /12) and J^2 = (X; /21, /22) - as explained 
directly after definition [1] The space EI(X) is endowed with the Hausdorff 
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metric duiX) derived from the Euclidean metric dx on X. In particular, since 
the functions fij are continuous, the mappings J-^ : EI(X) — > EI(X) are indeed 
continuous and F is a well-defined IPS. By Theorem [H (]HI(X), (ie(x)) is a 
compact, and hence normal, metric space. Again invoking Theorem [H it 
follows that (EI(EI(X)), (ie{H(x))) is also a compact, and hence normal metric 
space. It follows that F : e(e(X)) -^ e(e(X)) defined by 

F(B) =J-i(B)UJ'2(B) 

for all B G ]HI(]HI(X)). is continuous with respect to the Hausdorff-Hausdorff 
metric da(mOL)), where 

J^i{M) = {Ti{B) : B eM} C M(e(X)) 

for all B G EI(EI(X)). Consistent with the terminology in [5], [6], [7], an 
attractor of such an IFS F is called a superfractal. A superfractal thus con- 
sists of a set A whose elements are compact subsets of X. The set A is itself 
compact in the Hausdorff-Hausdorff metric. Theorem 3 tells us that such an 
attractor can be computed by means of the chaos game, regardless of whether 
or not there exists a metric such that the constituent mappings are contrac- 
tive. Many examples of approximations to sets belonging to superfractals, 
calculated using the chaos game algorithm, are illustrated in [5] . These calcu- 
lations were made, without any special care over whether or not the random 
selections were precisely i.i.d. or even whether or not the constituent IFS's 
were contractive. This paper justifies such apparent carelessness. 
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